CDMA: A Practical Cross-Device Federated Learning Algorithm for General Minimax Problems
نویسندگان
چکیده
Minimax problems arise in a wide range of important applications including robust adversarial learning and Generative Adversarial Network (GAN) training. Recently, algorithms for minimax the Federated Learning (FL) paradigm have received considerable interest. Existing federated general require full aggregation (i.e., local model information from all clients) each training round. Thus, they are inapplicable to an setting FL known as cross-device setting, which involves numerous unreliable mobile/IoT devices. In this paper, we develop first practical algorithm named CDMA setting. is based on Start-Immediately-With-Enough-Responses mechanism, server signals subset clients perform computation then starts aggregate results reported by once it receives responses enough With resilient low client availability. addition, incorporated with lightweight global correction update steps clients, mitigates impact slow network connections. We establish theoretical guarantees under different choices hyperparameters conduct experiments AUC maximization, training, GAN tasks. Theoretical experimental demonstrate efficiency CDMA.
منابع مشابه
A Genetic Algorithm for Minimax Optimization Problems
Robust discrete optimization is a technique for structuring uncertainty in the decision-making process. The objective is to find a robust solution that has the best worst-case performance over a set of possible scenarios. However, this is a difficult optimization problem. This paper proposes a two-space genetic algorithm as a general technique to solve minimax optimization problems. This algori...
متن کاملA Practical Algorithm for General Large Scale Nonlinear Optimization Problems
We provide an eeective and eecient implementation of a sequential quadratic programming (SQP) algorithm for the general large scale nonlinear programming problem. In this algorithm the quadratic programming subproblems are solved by an interior point method that can be prematurely halted by a trust region constraint. Numerous computational enhancements to improve the numerical performance are p...
متن کاملMinimax Algorithm for Learning Rotations
It is unknown what is the most suitable regularization for rotation matrices and how to maintain uncertainty over rotations in an online setting. We propose to address these questions by studying the minimax algorithm for rotations and begin by working out the 2-dimensional case. The problem of online learning of rotations is defined as follows. In every iteration t = 1, 2, . . . , T , the lear...
متن کاملA Derivative-Free Algorithm for Linearly Constrained Finite Minimax Problems
In this paper we propose a new derivative-free algorithm for linearly constrained finite minimax problems. Due to the nonsmoothness of this class of problems, standard derivative-free algorithms can only locate points which satisfy weak necessary optimality conditions. In this work we define a new derivative-free algorithm which is globally convergent toward standard stationary points of the fi...
متن کاملA Simple SQP Algorithm for Constrained Finite Minimax Problems
A simple sequential quadratic programming method is proposed to solve the constrained minimax problem. At each iteration, through introducing an auxiliary variable, the descent direction is given by solving only one quadratic programming. By solving a corresponding quadratic programming, a high-order revised direction is obtained, which can avoid the Maratos effect. Furthermore, under some mild...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i9.26246